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Adaptive Filters Revisited - RFI Mitigation in Pulsar 
Observations 
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Pulsar detection and timing experiments are applications where adaptive niters seem 
eminently suitable tools for radio-frequency-interference (RFI) mitigation. We describe a 
novel variant which works well in field trials of pulsar observations centred on an 
observing frequency of 675 MHz, a bandwidth of 64 MHz and with 2-bit sampling. 
Adaptive filters have generally received bad press for RFI mitigation in radio astronomical 
observations with their most serious drawback being a spectral echo of the RFI embedded 
in the filtered signals. Pulsar observations are intrinsically less sensitive to this as they 
Q | operate in the (pulsar period) time domain. The field trials have allowed us to identify 

those issues which limit the effectiveness of the adaptive filter. We conclude that adaptive 
filters can significantly improve pulsar observations in the presence of RFI. 
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1. Introduction 

The days of interference-free observations in ra- 
dio astronomy are now long gone. Increasingly, 
observations such as the search for red-shifted HI 
will need to be made outside the bands allocated 
to radio astronomy. There are also substantial 
pressures from commercial, defence and other in- 
terests for greater access to the radio-frequency 
spectrum. This means that the radio astronomers 
can no longer rely on the regulatory authorities 
for an interference- free environment; we need to 
explore the possibilities for co-existence. 
The work described in this paper was prompted 
by the commissioning of a new digital TV trans- 
mitter located on Mt. Ulandra, about 200 km 
south of the Parkes observatory. This transmit- 
ter operates at a frequency of 645 MHz which is 
within the bandpass of one of the receivers used 
for pulsar observations. Figure 1 shows the cur- 
rent RFI environment at Parkes at these frequen- 
cies and the location of three further transmitters 
scheduled for commissioning in the near future. 
While repositioning the receiver bandpass might 
avoid this particular source of radio-frequency- 
interference (RFI) , it is clear that the observatory 
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needs to continue to develop its expertise in RFI 
mitigation. 

The adaptive filter is one of the promising areas 
of interference mitigation: the filter detects the 
presence of interference in the astronomery data, 
and derives a suitable correction function to re- 
move (or at least reduce) the interference. Several 
groups at the Australia Telescope National Facil- 
ity have been engaged in RFI mitigation experi- 
ments for a number of years, concentrating in par- 
ticular on the post-correlation class of adaptive 
filters (Briggs et al. 2000; Kesteven 2004). This 
work has been successful in demonstrating use- 
ful RFI mitigation in spectroscopy experiments. 
While the post-correlation adaptive filter may be 
applicable to pulsar observations, it will be ex- 
pensive in computational resources. 
In this paper, we show that the original form of 
the adaptive filter is an effective and cost-efficient 
solution to the requirements of pulsar observa- 
tions. 

2. The Adaptive Filter 

Figure 2 summarises the RFI problem to be solved 
and the nature of the solution. The astronomi- 
cal antenna collects signals from some target re- 
gion on the sky. The receiver responds to the 
astronomical signals primarily from the antenna's 
main beam. The antenna also receives interfer- 
ence through one of the many antenna sidelobes. 
Astronomers will find their data corrupted by this 
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interference - at times to such an extent that the 
data are useless. 

An adaptive filter is a device that can remove 
much of the interference from the astronomy sig- 
nal without affecting the astronomical informa- 
tion. The hardware consists of a reference an- 
tenna, organised to be very responsive to the in- 
terference, and to have little or no response to the 
astronomy signal. The heart of the device is a fil- 
ter which acts on the reference antenna signal to 
modify it into a close copy of the interference in 
the astronomy channel. A subtraction will then 
yield a cleaned astronomy signal that is free of in- 
terference. The third component of the adaptive 
filter is a mechanism to control the filter in order 
to meet some optimising criterion. Such a device, 
based on a convolutional filter, was described in 
detail by Barnbaum & Bradley (1998). It is an el- 
egant scheme which operates directly on the inter- 
mediate frequency band (IF) that the astronomer 
would direct to final processing stage - the pulsar 
de-dispersing, folding and timing computer in our 
case. 

Assume, for the moment, that the system is op- 
erating in a narrow radio frequency band. In this 
case, we would require the filter to adjust the gain 
and phase of the reference IF until the interfer- 
ence is a good match to the interference in the 
astronomical channel. A subtraction will yield an 
intcrfcrcncc-frcc IF. Unfortunately the reference 
IF also contains noise from its receiver. Increas- 
ing the gain in order to balance the RFI will al- 
low an increasing amount of receiver noise into 
the output IF. Decreasing the gain degrades the 
interference cancellation. Since the astronomer 
generally does not distinguish noise power from 
interference power in his spectrum, the optimum 
filter gain (from the astronomer's perspective) is 
the setting with the minimum additional power in 
the output IF. 
More formally, let: 

Pout = N ast + P r fi x (c ast - g * c ref ) 2 + g 2 N ref 

where N is the receiver noise power in the astron- 
omy (ast) or reference (re/) channels, P r fi is the 
interference power at the site, c describes the com- 
plex voltage coupling of the interference into the 
two channels and g is the complex voltage gain of 
the filter. 

Minimising P out with respect to g leads to : 
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The power at this optimal gain setting is: 
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where INR is the ratio of the interference power 
in the reference IF to the noise power, 
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In other words, the astronomer will see the "in- 
terference" in his spectrum reduced from P (= 
clefPrfi) to P/(l + INR). With no filtering the 
spectrum is corrupted by interference; with the 
filter in operation the corruption is due to a small 
residue of interference along with a small fraction 
of noise from the receiver in the reference channel. 
The adaptive filter in practice operates over a 
wide frequency range. The scheme outlined above 
is readily modified to suit that need by recognising 
that the gain is frequency dependent and imple- 
menting the filter as a convolutional filter. The 
cross-spectrum output from the correlator is then 
the Fourier transform of the correction to the fil- 
ter weights. The filter weights are optimised when 
the cross-spectrum is zero. 

The correlator output will of course be subject 
to noise fluctuations which can be smoothed by 
averaging. The appropriate averaging time is set 
by the time scale on which the noise-free filter 
settings would change, i.e. by the time scale on 
which the coupling terms change. This is set by 
propagation considerations such as the relative 
delay between the reference and astronomy anten- 
nas, or the changing proportions of the multi-path 
propagation. As these are relatively slow effects, 
we used in the pulsar experiments a time scale of 
3 ms. 

The FIR weights are computed as follows. Let 
{wf} be the set of weights in use during the n- 
th integration, R(t) is the voltage in the refer- 
ence channel, A(t) the voltage in the astronomical 
channel and F(t) is the voltage output from the 
FIR filter, 



The cross-correlation terms can be written as 
C* = y^(^fc - Fk)R(k-i) 

k 

and the updated weights are 

w^ 1 = w " + ed 
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where e controls the convergence of the filter 
to the optimum setting. The loop is critically 
damped when e = 1/Tsys re f. 
This filter has a number of desirable qualities: 

1. It adapts automatically to changes in the 
coupling coefficients. This is important as dif- 
ferent sidelobes could be involved as the antenna 
follows a source. The relative delay between the 
reference and astronomical antennas may change 
if the interference source is moving (e.g., a satel- 
lite). It will accomodate to changes in the receiver 
gains. 

2. The filter is robust to multi-path propaga- 
tion. 

3. The filter action ceases when the interference 
ceases. There is no noise penalty at low to zero 
interference. 

4. It can handle multiple independent sources 
of interference provided that there is no overlap 
in frequency. 

5. Filters can be cascaded which would allow 
the system to accommodate sources which over- 
lap in frequency. This strategy is also relevant if 
the interference is so spread out in direction that 
multiple reference antennas are required. 

To the astronomer's eye, the filter reduces the 
interference-related noise power by an attenuation 
factor equal to 1/(1+INR). The filter starts to be- 
come ineffective when INR ~ 1. 

3. The Field Trials 

The Parkes observatory has an on-line pulsar pro- 
cessor (known as CPSR2) that was constructed 
by the Caltech and Swinburne University groups 
(Bailes, 2003). This unit streams two base- 
band IFs (two polarisations, each IF sampled at 
128MSamples/sec), each 64 MHz wide to a disk 
farm, for real-time processing by a bank of 32 PCs. 
Each PC is assigned a 1-GByte file for dedispers- 
ing, folding at the pulsar period and timing. Our 
long-term aim is to build a hardware adaptive fil- 
ter and install it ahead of the processor and other 
data acquistion systems. 

For the current experiments we exploit the 
CPSR2 architecture to develop the interference 
rejection algorithm and explore the practical dif- 
ficulties in RFI mitigation with the use of a soft- 
ware filter. The schemes are shown in figure 3. 
The software filter cannot support real-time oper- 
ation, but in every other respect it provides a com- 
prehensive trial. We take two disk files, one with 



dual-polarisation pulsar data, the second with the 
IF from the reference antenna and we adaptivcly 
filter the pulsar data to create a fresh file with 
filtered data. This file is inserted back into the 
system for standard processing. 
The reference antenna is mounted on the tallest 
tower at the observatory and has been oriented to 
maximise the signal received from Mt. Ulandra. 
The original experiments used a yagi antenna; this 
has since been replaced by a 3.5m diameter an- 
tenna. The astronomical targets are a variety of 
pulsars that are detectable in a 16-sec observa- 
tion. Most of the results shown below are based 
on the millisecond pulsar PSR J0437— 4715 which 
has a period of 5.7 ms. The observing band centre 
is set to 675 MHz, the bandwidth to 64 MHz and 
we use 2-bit sampling. 

The observations can address the following ques- 
tions: 

1. Docs our filter implementation behave as 
predicted? 

2. Does our filter introduce pulsar specific side- 
effects? 

3. Are there other factors which limit the effec- 
tiveness of the filter in mitigating the RFI? 

4. Are there specific sampling issues that need 
to be addressed? 

3.1. Filter Performance 

We have implemented in software the filter shown 
in figure 2. Although the data is 2-bit sampled, 
all the operations within the filter are 32-bit float- 
ing. The output is normalised and resampled to 
8-bits to provide data in a format suitable for the 
down-stream processing. 

The FIR filter has 128 taps (the number of delay 
steps in the filter), as does the cross-correlator. 
The spectral resolution is a sin(x)/x window of 
width 1 MHz, set by the sampling rate (128 MS/s) 
and the number of taps. The FIR weights are re- 
vised every 3 ms. The weights will need to be up- 
dated if there are changes in the way the interfer- 
ence appears in the reference and astronomy IFs. 
For example, while the main antenna is follow- 
ing a sidereal target its sidelobes will track over 
the source of interference. The interference may 
also suffer multipath propagation to the reference 
antenna leading to episodes of fading. Our exper- 
iments suggest that at our site the characteristic 
timescalc for these effects (see figure 5) is mea- 
sured in seconds. 

Figure 4 provides an overall picture of the filter's 
performance. It shows the IF power spectra be- 
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fore and after filtering. The INR is large and the 
residual noise (the difference between the filtered 
spectrum and the RFI-frce receiver bandpass) is 
low, consistent with the large INR in the reference 
channel. 

Figure 5 presents a different perspective. The fil- 
ter is analysed at 3 ms integrations during the 
processing. This example was selected to high- 
light a problem: during the 16 second observation 
the RFI amplitude changed in both the reference 
and astronomy channels independently We be- 
lieve that this is due to multipath propagation 
acting independently on the astronomy and refer- 
ence channels. The 3 ms update interval is ade- 
quate to follow these changes, and the attenuation 
tracks the INR as predicted. 
Our observations all indicate that the filter be- 
haves as predicted, with a clear message that 
maintaining a large INR is vital. 

3.2. Are there Side-Effects? 

Our brief is to ensure that the filter does not affect 
the spectral, polarisation or timing characteristics 
of the pulsar. Our approach has been to do de- 
tailed comparisons of the processed data - with 
and without filtering. 

Figures 6 and 7 show the typical raw material, 
the output from the pulsar processor with data 
folded at the pulsar period. There are 2048 chan- 
nels along the pulsar phase axis and 128 along the 
frequency axis. The data has been de-dispersed, 
so the pulsar's "pulse" is visible as the vertical 
trace near pulsar phase 0.5. The basic question 
is whether the pulse in the RFI spectral channels 
has the same characteristics as the pulse in the 
RFI-free channels. 

Figure 8 provides an analysis of the data in figures 
6 and 7. These figures show the detected power, 
after folding and de-dispersing, as a function of 
pulsar phase and observing frequency {P{<j>, /))• 
Each column in figure 8 has four plots. The 
first plot shows the power spectra (/ P(0, f)d(f>) 
and the second plot shows the pulsar amplitude 
(/ P{4>, f)df). The effect of the RFI in the unfil- 
tered is evident in increased noise throughout the 
pulsar phase. The third plot shows the pulse peak 
amplitude ("IS H function of frequency to show the 
RFI effect in more detail (J ° 45 5 P{cj>, /)#). The 
full impact of the RFI is shown in the fourth plot, 
the signal-to-noise ratio in the peak amplitude. 
Outside the RFI range the filtered and unfiltered 
data are identical (to within the re-sampling er- 
ror) . In the RFI range the filtered data are consis- 



tent with interpolations from the adjacent chan- 
nels. For these observations the reference signal 
was obtained from the 3.5m antenna. 

3.3. Additional RFI Mitigation Problems 

At this stage in our investigations we conclude 
that the adaptive filter could provide a solution 
to the RFI mitigation question provided that we 
can master the apparently random and uncorre- 
cted power variations in the RFI that are shown 
in figure 5. 

We suggest that the underlying mechanism is mul- 
tipath propagation which leads to destructive in- 
terference. We are exploring a number of counter- 
measures: 

• Installing a larger antenna which could raise 
the signal power and reduce the number of multi- 
path rays. 

• Installing a second reference antenna dis- 
placed from the first to provide some spatial di- 
versity. We would need to add an intelligent IF 
switch to select the better of the two filtered IFs. 

• Exploiting the known coding algorithm of the 
digital TV to reconstruct a better reference sig- 
nal with higher (and stable) INR. A variant of this 
strategy has been demonstrated as way to miti- 
gate GLONASS RFI by Ellingson et al. (2001). 

3.4. Sampling Issues 

Two-bit sampling has not been a limitation to 
these experiments. Even though the RFI is sub- 
stantially larger than the receiver noise, it is con- 
fined to about 10% of the receiver bandpass and 
does not dominate the noise presented to the sam- 
pler. We suffer a further penalty in the resam- 
pling stage at the filter output. However, the 
present experiment suggests that such loss is mod- 
est. Care is also required in the resampling stage 
since the filtered data may retain echoes of the 
original two-bit sampling; a poor setting of the 
thresholds can negate much of the filter's action. 
As pulsar observers lock the sampler thresholds 
during an observation, non-stationarity might 
seem to be an additional potential source of trou- 
ble. However, the adaptive filter should be neutral 
to this provided that the relation between mea- 
sured and true correlation coefficients remains lin- 
ear. See Jenet and Andersen (1998) for a detailed 
discussion of this issue. 
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4. Conclusion 

The results of this program are encouraging - we 
believe that the adaptive filter will be able to pro- 
vide a satisfactory level of RFI mitigation. We 
will shortly move to a hardware implementation 
of the filter. 

It is clear that the mitigation can only succeed if 
we have a high quality copy of the interference; 
we will need to devote more time and effort into 
this side of the problem in the coming months. 

Acknowledgments. 

We are grateful to Dr. S. Ord (Swinburne University) and 
Dr. J. Reynolds (ATNF) for valuable advice and assis- 
tance in the course of this program. We acknowledge the 
support of the observatory staff at Parkes. The Parkes ra- 
dio telescope is part of the Australia Telescope which is 
funded by the Commonwealth of Australia for operation 
as a National Facility managed by CSIRO. 



References 

Bailes, M Radio Pulsars ASP Conference series CS- 

302, 57, 2003. 
Barnbaum, C. and Bradley, R.F. A.J. 115, 2598, 

1998. 

Briggs, F., Bell, J. and Kesteven, M. A.J. 120, 3351, 
2000. 

Ellingson, S.W., Bunton, J.D. and Bell, J.F. 

Ap.J.Suppl. 135, 87, 2001 
Jenet, F.A., Andersen, S.R. PASP, 110, 1467, 1998. 
Kesteven, M New Technologies in VLBI, nov. 2002, 

Gyeong-Yu, Korea. ASP Conference series CS-307, 

93, 2003. 



M. KESTEVEN, AUSTRALIA TELSECOPE NA- 
TIONAL FACILITY, CSIRO, AUSTRALIA, (michael.kesteven@csiro.au) 



(Received 



) 



KESTEVEN ET AL.: ADAPTIVE FILTERS FOR PULSAR OBSERVATION 



F.«f -*0 dBm 



•RBW 30 kHz Xjzker | [71 ] 
■VEU 300 Hi -91.13 rtBm 

SHT 22.5 a £90.000000000 Mfll 




Figure 1. The RFI environment at Parkes in the 50cm band. The frequency span in the image is 200 MHz. 




Figure 2. The pre-detection filter. We require a reference antenna which captures a copy of the 
interference while remaining insensitive to the astronomical signal. The filter modifies the reference 
antenna's signal into a close copy of the interference in the astronomy signal. 
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Figure 3. The pulsar processing models. The top figure shows the current implementation. The 
middle figure shows our long term aim: a real-time hardware filter which cleans the IF ahead of 
the CPSR2 processor. The lower figure shows our development mode: a software filter operates 
on a file of data, replacing it with a filtered version for subsequent processing. In this mode the 
operation is not real time. 
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Figure 4. The filter in action. The top panel shows the raw astronomy IF, the middle panel shows 
the reference IF (INR ~ 50:1) and the lower panel shows the filtered IF. 
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Figure 5. The filter in action. Each plot shows the filter performance in one selected frequency 
channel (number 25), computed every 3 ms. The plot at the lower right shows the attenuation 
(filtered excess noise power divided by the excess noise in the raw astronomy IF, where "excess 
noise power" is the amplitude above the RFI-free level). The attenuation computed from the INR 
of the reference IF is also shown - it is the trace which is essentially free of noise. 
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Figure 6. The output from the pulsar processor after de-dispersion and folding at the pulsar 
period of a 16.7-sec segment of unfiltered data. 



0+37-4715 f.ltered2004 - 09 - 26-2J:03:00.0_cpsr14.DT 




0,4 0.6 
Pulse Phose 



0.3 



Figure 7. The output from the pulsar processor after de-dispersion and folding at the pulsar 
period of filtered data. 
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Figure 8. A statistical summary of figures 6 and 7. The top panel shows the mean power in each 
frequency channel. The second panel shows the pulse profile. The third panel shows the amplitude 
of the pulsar pulse, at each frequency; it is the power summed over a narrow window in pulsar 
phase centred on the pulse peak. The fourth panel shows the Signal-to-Noise ratio of the pulse 
amplitude. 



